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IDENTIFICATION OF MULTITYPE BRANCHING PROCESSES 

By F. Maaouia and A. Touati 

Faculte des Sciences de Tunis and Faculte des Sciences de Bizerte 

We solve the problem of constructing an asymptotic global confi- 
dence region for the means and the covariance matrices of the repro- 
duction distributions involved in a supercritical multitype branching 
process. Our approach is based on a central limit theorem associated 
with a quadratic law of large numbers performed by the maximum 
likelihood or the multidimensional Lotka-Nagaev estimator of the re- 
production law means. The extension of this approach to the least 
squares estimator of the mean matrix is also briefly discussed. 

On resout le probleme de construction d'une region de confiancc 
asymptotique et giobale pour les moyennes et les matrices de covari- 
ance des lois de reproduction d'un processus de branchement mul- 
titype et supercritique. Notre approche est basee sur un theoreme 
de limite centrale associe a une loi forte quadratique verifiee par 
l'estimateur du maximum de vraisemblance ou l'estimateur multidi- 
mensionnel de Lotka-Nagaev des moyennes des lois de reproduction. 
L'extension de cette approche a l'estimateur des moindres carres de 
la matrice des moyennes est aussi brievement commentee. 

1. Introduction. 

1.1. Motivation. Statistical inference about the means and/or the covari- 
ance matrices of the reproduction distributions involved in a positively regu- 
lar supercritical Bienayme-Galton-Watson process with tf-types [BGW((f)] 
has been investigated by several authors [2, 4, 5, 14, 26]. Though some im- 
portant work (discussed below) has been done on this topic, a satisfactory 
global approach has not been outlined. The purpose of this article is to fill 
this gap. 

For the convenience of the reader, our method is initially derived in the 
familiar context of the one-type BGW process. So, let X = (X n ) n >o be a 
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supercritical process starting from Xo = 1. The identification of the mean 
a =E(Xi) e]l,+oo[ and the variance a 2 = Var(Xi) e]0, +oo[ of the off- 
spring distribution of X is a classical problem which has been studied by 
many. An exhaustive review of this topic can be found in [14]. 

Let us recall some significant results in connection with this subject. The 
maximum likelihood estimator of a, given by 

n 

(1-1) a n = (S n _i) _1 (S n - 1), S n = ^X fc , 

k=0 

satisfies the relation 

n n 

(1.2) S n _!(a n - a) = £(X fe - aX fe _x) = £(X fc - E(X fc /^ fc _ 1 )) = L n , 

k=l k=l 



where J- n is the a-algebra generated by the random variables (r.v.'s) Xq, • • • , X n . 
It is strongly consistent on the set of nonextinction E = {lim n _ >00 S n = oo} = 
{linin^ooX,! = oo}. Moreover, conditional on E, the central limit theorem 
(CLT) with random normalization, 



(1.3) VSnZ^ian - a) M{0, a 2 ), 

n — ►oo 

holds [11, 12, 13, 14, 16, 17, 19, 20, 21, 23, 24]; Af(0,a 2 ) denotes the centered 
Gaussian distribution with variance a 2 . As pointed out by Dion [13, 14], 
conditional on the set E n = {X n > 0}, the result (1.3) is also true. 

To build a confidence region for a, it remains to estimate a 2 . Dion [13] 
and Heyde [18] proved that 



1 " 

&l = - X fc-i( x fe ~ a n X fc _i) 2 
1 

- V X fc „i(a fc - d n ) 2 — > a 2 a.s. on E, 



ri * — * n — >oo 

k=l 

where d n = X~^ 1 X„,l|x n _ 1 >o} is the Lotka-Nagaev estimator of a, subse- 
quently called the empirical estimator of a, which is also strongly consistent 
on E. In addition, under the assumption E(Xj) < oo, they showed that 

^(a 2 -a 2 )^AT(0,2a 4 ). 

n — >oo 

We improve their result here by showing that, conditional on the set E 
or E n , 

(1.5) {^(o-- 2 a 2 n -l),^S n ~ 1 a- 1 (a n -a)} M(0, 2) ® M(0, 1) 
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and 

(1.6) limsupw- o ~a — 1 = 2 a.s., 

V In Inn 

where ® denote the tensor product of measures. 

A similar approach for estimating a 2 may be derived from the following 
property satisfied by the martingale (L n ), called the quadratic strong law of 
large numbers (QSL) in [8, 9] (see also [28]): 

1 n 

(1.7) -^(S^fLfc) 2 — a 2 a.s. on E. 

k=l 

From (1.2) and (1.7), it is easy to derive that 



1 n 

(1.8) o\ = - Y*Sfc_i(a fc -a n ) 2 — ► a 2 a.s. on E. 



77 ' — * n — >oo 

k=l 



We shall prove here that, under the additional hypothesis E(Xf ) < oo and 
conditional on the set E, the following two properties hold: 

(1.9) {V^{a~ 2 a 2 n -l),^T l d~ 1 {a n -a)} mU, ® AA(0, 1); 




(1.10) limsupw- — \o~ 2 a 2 l — l\ = 2\l— — a.s. 

V mlnn 

Hence, the estimator a 2 is asymptotically more efficient than a 2 ; however, 
it is insensitive to any change that occurs on the mean. 

In the remainder of this article, the global approach we develop for the 
one-type BGW process is generalized to the d-type case. Moreover, results 
analogous to (1.8), (1.9) and (1.10) for the empirical estimator and the least 
squares estimator of the reproduction law means are discussed. 

1.2. Assumptions. 

1.2.1. About the observed sample. From now on *X n = (X n (l), . . . , X n (d)) 
denotes the generic state of a BGW(<i) process, that is, the column vector 
of numbers of particles (or individuals) of each type in the nth generation. 
The initial state Xo is taken equal to the vector 1 whose components are 
equal to 1. 

The particles of type j that are alive in the (n — l)st generation give birth 
to a total number of Y J n (l) particles of type 1, . . . , Y^(d) particles of type d. 
Therefore, we have 

(1.11) X n = £ Yl Yi = *(Y£(1), . . . , Yi(d)). 
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Except in Section 5, we suppose that the r.v.'s (Xo, Yj, . . . , Y£; 1 <j < d) 
are observable and we denote by Q n the cr-algebra they generate. 

1.2.2. About the reproduction laws. The following common assumptions 
will be used subsequently. 

Assumption A-l. For each j G {1, . . . ,d}, the reproduction distribution 
Uj of the particle (or individual) of type j is assumed to have finite moments 
of order 25 (<5 e]1,2]) and an invertible covariance matrix. 

Assumption A-2. The BGW(d) process (X n ) n > is assumed to be pos- 
itively regular and supercritical (see [3, 25] for the details). 

The column vector that represents the mean of Uj and its covariance 
matrix are denoted a 3 and K 3 , respectively. 

1.3. Brief description of the main results. In the three next sections we 
are concerned with estimation of the parameters {a 3 , K 3 }i<j< ( ] i based on ob- 
servation of the sample {Xo, Yl; 1 < k <n, 1 < j < d}. More precisely, we an- 
alyze in Section 2 the asymptotic behavior of the maximum likelihood estima- 
tor (MLE) A n and the empirical estimator (EE) A^ n of A = Vect(a 1 , . . . , a d ) 
(see Section 1.4 below). For each one of these estimators, we shall (1) prove 
strong consistency on the set of nonextinction E and also give the strong 
rate of convergence, and (2) prove asymptotic normality conditional on the 
set E n = Uj=i{X n (j) > 0} after appropriate centering and random normal- 
ization. 

In Section 3 we show that A n and A^ n satisfy two QSLs as in the case of 
the one-type BGW process. This allows us to derive two estimators JC n and 
& n of K, = DiagjA' 1 , . . . , K d }. We prove also their strong consistency on E 
and sharpen their strong rate of convergence. 

The construction of a global confidence region for the parameters 
{a 3 , K 3 }i<:j<d is achieved in Section 4 thanks to a central limit theorem 
performed by the pair (A n ,IC n ) or (A n ,fc n ). 

Finally, in Section 5, a similar approach is discussed for the least squares 
estimator (LSE) of the matrix A = [a 1 , . . . , a d ] . 

1.4. Notation. We recall some standard notation. 

Nl. Id and I^ 2 denote, respectively, the d x d and the d 2 x d 2 identity ma- 
trices. 

N2. For a real d x d matrix B whose column vectors are b 1 , . . . , b d , 
Vect(B) = Vect(b 1 ,...,b d ) 

= *(b\l),...,b\d),...,b d (l),...,b d (d))€R d2 . 
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N3. The notation Diag(.E>i, B2) refers to the block matrix ^ B . 

N4. If A = {a,ij)ij and B = (b r i) r i are two matrices, A® B = (o-ijB)ij 
designates the block matrix whose block is aijB. 

We also introduce the following less common notation on block matrices: 

N5. If P = (P(i,j))i<ij<d and Q = (Q(r,l))i< r j<d are two block matrices, 
then PMQ = ((P(i,j) <8) Q(r, l))i< r ,i<d)i<i,j<d stands for the block ma- 
trix whose block is the block matrix (P(i,j) (g> Q{r,l))\< r j<d- 

N6. If C = (C(i, j))i<i j<d is a block matrix, then ± C denotes the block 
matrix (C(j,i))i<ij< d - 

The standard Euclidean inner product on M q and its associated norm are 
denoted by (•, •) and || • ||, respectively. The trace operator on square matrices 
is denoted by tr(-). 

2. Estimation of the reproduction means. From the definition of 

(71— 1 \ — 1 71 

£x P o-) y, y i and 4=x n - 1 or 1 Yii {Xn _ 1(i)>0} 
p=0 / p=l 

are intuitively candidates for estimating a 3 . Clearly, a? n is the multidimen- 
sional analog of the empirical estimator defined in Section 1.1. As is shown 
below, a? n is in fact the MLE of a 3 , that is, the estimator derived by maxi- 
mizing each component of a 3 . 

2.1. Computation of the maximum likelihood estimator of A. Let J- n de- 
note the c-algebra generated by the r.v.'s (Xo, Xi, . . . , X n ). The conditional 
distribution of X n+ i with respect to J- n is z;* Xn W * ••• * v*^ n<yd \ where 
Vj k represents the convolution product of k distributions equal to Vj. Con- 
sequently, the following useful construction of the Markov chain (X n ) is 
available. Given a probability space (fi,.F,P), let k)(n,k)eN 2 }i<j<d be a 

system of d independent sequences of r.v.'s on (fi, P), where k)(n,k)eN 2 
are i.i.d. random vectors with respect to the distribution Vj. More precisely, 
the vector £ J n k represents the successors of the fcth particle (or individual) 
of type j that are alive in the (n — l)st generation. Hence, we have 

/Xn-l(j) \ 

(2-2) Yi=^ £ Zi tk ji { x n _ im0h je{l,...,d}. 

The likelihood function of the r.v.'s {Xo, . . . ,X n } is 

n 

£ n = £ n (X , . . . ,X n ) = J] vl Xp - lW ^ p - l(d) (K p ) 

P =i 
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(2.3) d 

=nfnfn^) N ^)), 

p =i \j=i \ lerij I J 

where for each j G the r.v.'s Nj(J) = E?=i" l(i) ^ =/}> 1 G 

satisfy the properties 

^N^(/)=X p _ 1 (j), £jNj(0=Y>, 

and for 1 < j < d, Vj = {I G N d /zA,(/) > 0} is the support of the reproduction 
distribution i>j. Therefore, using the Lagrangian technique, we prove that 
the r.v.'s 

(2-4) V j{l) n = E x p0') EW leVj, 

\p=0 / p=l 

maximize £ n , but we emphasize the fact that Vj(t) is an estimator of Vj{l) 
only if the r.v.'s fc ) are observable. However, the MLE of the mean a? of 
i/,-, obtained by maximizing each component of a 3 , that is, 

(n-i \ -i n 

p=0 / p=l 

coincides with a^. It is a statistic of the observed sample {Xo, Yf , . . . , Y£, 
1 < j < d}. Hence, the MLE of A is 

n 

(2.6) A n = Vect(al ...,a d n )= <?n-i E Vect(Y*, . . . , Yj), 

p=i 

where 5 n = Diag(S n (l)I d , . . . , S n (d)I d ) and S n _i(j) = Ep=o Xptf)- 
In particular, let us remark that 

n 

(2.7) 5 n _ 1 (X-^) = ^a, where Cfc = Vect(Ci J ...,C*), 

fc=i 

and 

/Xfc-iC?) \ 
2.2. Asymptotic properties of the MLE of A. 
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2.2.1. Main result. The asymptotic properties of (A n ), announced in 
Section 1.3 and stated below, are in fact direct consequences of those of the 
martingale defined by the right-hand side of (2.7). 

Theorem 2.1. Let X= (Q,J-,¥,(X. n ) n >o) be a d-multitype branching 
process, starting from 1 = *(1, . . . , 1) ; whose reproduction distributions sat- 
isfy Assumptions A-l and A-2. Then the following properties hold, where 
E designates the set of nonextinction o/X and E n = Uf=i{X n (j) > 0}- 

(i) The estimator (A n ) is a strongly consistent estimator of A on the 
set E; more precisely, 

max \\p k/2 (Ak - A)\\ 2 = 0(lnn) a.s. on E. 

l<fc<n 

(ii) The estimator (An) is asymptotically normal; more precisely, condi- 
tional on the set E or E n , 

S 1 J^(X-A) r ^ o Af d2 (0,K). 

Remark 2.2. The estimation of the offspring means of a supercritical 
multitype branching process has been studied by Asmussen and Keiding [2], 
Keiding and Lauritzen [22] and Nanthi [1, 26]. Their results are strictly 
contained in Theorem 2.1. 

The proof of Theorem 2.1 is based on some important asymptotic proper- 
ties of the martingale defined by (2.7), which is stated in Lemma 2.3 below. 

2.2.2. Auxiliary results for the proof of Theorem 2.1. Before stating the 
lemma, let us recall that Assumption A-2 allows us to affirm that the fol- 
lowing three conditions are satisfied by A = [a 1 , . . . , a d ] (the matrix whose 
column vectors are a 1 , . . . , a d ): 

CI. The matrix A has a maximal eigenvalue p > 1, which is equal to the 

spectral radius of A. Moreover, the modulus of each other eigenvalue 

of A is strictly less than p. 
C2. There exist an eigenvector u = * [u(l), . . . , u(d)) of A and an eigenvector 

v = *(v(l), . . . ,v(d)) of *A (the transpose matrix of A), associated to 

p, such that 

d 

u(j)>0, Vl<j<d, («,1)=5>(j) = 1, 

i=i 
d 

(u,v) = ^2u{j)v(j) = 1. 
i=i 
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C3. If P = u*v, then there exits a matrix R that satisfies 

PR = RP, R n = 0(n d -V") for Po €]0,p[, A re = p n P+R n . 

Conditions CI and C2 imply that the set of nonextinction of the BGW(<i) 
process (X n ), that is, E = limsupE n , where E n = \Jj =1 {K n (j) > 0}, is not 
negligible. In fact, one can prove the existence of a r.v. W such that E = 
{W > 0}, P(E) > and the following properties hold almost surely: 

(Pi) p->,X n ) — ► W, p""X n — Wu. 

Moreover, P(W = 0) = if for all 1 < j < d the reproduction distribution Vj 
belongs to a regular exponential model. 
Using the obvious recursive relation 

d 

X n — AX n _x + £ n , £ n — S ^ 

i=i 

condition C3, combined with the law of the iterated logarithm, allows us to 
prove the following property more precisely than (Pi): 

(Pi) p~ n X n - Wu = 0{Vh^m d - l 9 n ) a.s. on E, where 9 = ( max(p "' x) ). 

Let (M n ) be the normalized martingale defined from the right-hand side 
of (2.7) by 



M n = zrV2£-V2 C k = Vect(Mi, . . . , M d n ), 

Mi = «0r 1/2 (^')~ 1/2 E & U = Diag(^(l)I rf , . • .,u(d)l d )- 

fc=i 

Note that its predictable quadratic variation is 

{M) n = Diag( U (l)- 1 S n _ 1 (l)I d , . . . Mdy^n-Mld) 

(2.9) 



Lemma 2.3. The following properties hold for the martingale (M n ), 
where E, E n are the sets defined above in Theorem 2.1. 

(P2) We have p~ n {M) n — ► xrr^d 2 a.s. on E, where W is the r.v. de- 
fined in (Pi). 

(P3) We also have maxi<fc< n ||/5~ fc / 2 .Mfc|| 2 = O(lnra) a.s. on E. 
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(P 4 ) For t G W d2 andk<n, let <p n ,k(t) = E(exp{i(t, p- n / 2 AM k )}\Gk-i) 
and $ n (i) = Uk=i<Pn,k(t)> where &M k =M k -M k -i. Then 

. . f 1 W „ „nl 

$n(*) — * ex PS \\t\\ r a.s. on E. 

n^oo I 2/9—1 J 

(P 5 ) Conditional on E orE n , p~ n / 2 .M n -^ n ^oo £((W/p - l) 1 / 2 !"^) sta- 
6/?/, where S(T) is a r.f. independent of W urai/i i/ie same distribution as 
M d 2(0,T*T). 

PROOF of Theorem 2.1. To get the strong consistency of the estimator 
(A n ) on E, we note from (2.7), (2.8) and (2.9) that 



P 



n/2 



(A n -A) = p^S-^lC^Mn 

= U- 1 l 2 ( P ~ n (M) n )- l K}l 2 (p- n l 2 M n ), 



but thanks to properties (P2) and (P3) satisfied by the martingale M, we 
have 

max \\p~ k l 2 Mk\\ 2 = O(lnn) and p~ n (M) n — > W l d 2 a.s. on E. 

l<fc<n ra— >oo p — 1 

Hence, (i) is proved. 

By (Pi), we have p~ n S n -\ — > n ^oo ^rr^ a - s -> so property (ii) of the the- 
orem is a consequence of (P5), since 

(2.10) S l J\(A\ -A) = (p n l 2 S-^[ 2 )U l / 2 K l / 2 (p~ n l 2 M n ). □ 

Proof of Lemma 2.3. Equality (2.9) and property (Pi) imply (P2), 
that is, 

p- n (M) n =U- 1/2 (p- n S n ^ 1 )U- 1 / 2 — > -^-l d 2 a.s. on E. 

n — ► oo p — \ 

Property (P3) is obtained thanks to the following result satisfied by the r.v.'s 
Cn = Vect(C,...,C?): 



X„_i(j) 



a 3 ) 



k=l 



(2.11) =0( A /X n _ 1 (i)lnlnX n _i(j) 



= 0(y/p n lnn) on E. 
In fact, (2.11) is a consequence of (Pi) and the LIL property 

N 

H (£ 3 n,k ~a j ) = 0( V2N In In N ) a.s. 



fe=i 
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Since we have 



\k=l 



then 



\ \fc=i / 
0(/^ /2 vW), 



max \\p- k / 2 M k f = 0{\n n) a.s. on E. 

Kk<n 



Let us now prove properties (P4) and (P5). For t±, . . . , td S M. d , k <n and 
t = Vect(ti, . . . , td), we have 



so 



k=l 



(1 

n 



1 



x 1 n: =1 {x fc _ 1 o)> }- 



Sn-l(j) 



By noting that 



we deduce that 
d 



TT f 1 W 

*n(t) — ► 11 exp -\\tj 

«-»» 1J ; I 2p — 1 

7 = 1 >• f 



1 W 



exp< — 



2p-r 



a.s. on E. 



Property (P2) combined with property (P4) allows us to use Theorem 3 
of [27], which implies that, conditional on the set E = {W > 0}, 

W \V2_ 



(p- n/2 M n ) 



p-1 



1, 



stably, 



where S(T) is a r.v. independent of W with the same distribution as 
A/^O, T*T). As in [12], we can affirm that the above result is also true 
conditional on E n . □ 
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2.3. Asymptotic properties of the empirical estimator of A. From the 
definition (2.1) of aP n , we deduce that for j = 1, 2, . . . , d, 

X„-i(i) 

X„-i(j)K-a J )= (Zl,k- aJ ) 1 {Xn-i(j)>o} = & 
fc=i 

Hence, setting X n = Diag(X n (l)Lj, . . . , X n (d)Lj), the empirical estimator A\ 
of .4 satisfies the relations 

n 

(2.12) X n _ 1 (^ n -A) = Cn and S n _i(.4 n - A) = E X k-i(&k ~ A). 

k=l 

So property (i) of Theorem 2.1 holds for A^ n . An analogous result of prop- 
erty (ii) of this theorem may also be stated. 

3. Estimation of the reproduction covariance matrices. 

3.1. Some asymptotic properties of the sequences (S^ 1 (A n —-4,)) and 
{^n-i(^n — A)). As announced in Section 1.3, the key tool for constructing 
a strong estimator of the covariance matrices K, = Diag(if 1 , . . . , K d ) is the 

1/2 ^ 

QSL that underlies the CLT satisfied by the sequence (S n _ 1 (A n — A)) or 

{Xn-i(^n — A)). This property is stated in the second part of the next 
theorem. 

Theorem 3.1. Within the framework of Theorem 2.1, the sequence 

1/2 ^ 1/2 <T 

(S n _ 1 (A n — .4)) or (X n -\{A n — A)) satisfies the following properties almost 
surely on E. 

(iii) ASCLT: 

1 n 

-V 5 1/2, 2 ^ => A/" d 2(0,/C), 

k=l 
1 n 
k=l 

denotes the weak convergence of measures). 

(iv) QSL: 

1 n 

- E S l-Mk - A)*(A k - A)SIL\ -h, K, 

k=l 
1 n 

- E x l-i& - - A ) x l-i — ► £• 

n — ' n^oo 
fc=l 
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Moreover, if the reproduction distributions have finite moments of order 4, 
then 

(v) LIL of the QSL: 



lim sup - 



n 



In Inn 



^Eii^ 1/2 ^ 2 i(^-^)H 2 -^ 



k=l 



2d* 



lp+1 
p-1 



and 



lim sup 



n 



In Inn 



i n 



k=l 



2d. 



3.2. Construction of two strong estimators of K,. Using property (iv), 
we construct two strong consistent estimators of K, as stated in the theorem 
below. 



Theorem 3.2. Within the framework of Theorem 2.1, let 



1 



j = 1, . . . , d and 



k=l 



K J n = ~J2 X fe-i 0') - On)*(4 "« J J. j = 1, . . . , d and 



fc=l 



Diag(i^,...,it 



(vi) T/ien on the set of nonextinction E, 



IC n — > K, a.s., 

n— >oo 



/C a.s. 



(vii) Moreover, if the reproduction distributions have finite moments of 
order 4, then 



lim sup 
lim sup 



7? 



MK- 1/2 £nK- 1/2 )-d 2 \=2d> B±l 
In In n u p-1 



a.s., 



n 



In Inn 



tr(X;- 1 /2^- 1 / 2 )-d 2 | = 2d 



a.s. 



Remark 3.3. In [26], Nanthi proposed an estimator of a generic element 
of K 3 by adapting the Dion [13] and Heyde [18] method for estimating the 
variance of the offspring distribution of a BGW process (see Section 1.1). 
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Let us first prove Theorem 3.2. 

Proof of Theorem 3.2. We only prove the results announced for 

1/2 ^ 

the sequence (S n _ 1 (A n — A)), because those corresponding to the sequence 

(X^-ii^n — A)) can be established in the same way. 

By the property (iv) of Theorem 3.1, we can affirm that, for all 1 < j < d, 

1 n 

-E S ^0')( S i-^r(«i-« J )^^ «• onE. 

n k=l 

Since almost surely on E 



max \\S k _ l {j) l l\a? k -ai)t = 0[max \\slL\(A k - A)f ) = 0(lnn) 

l<fe<n \Kk<n 

and 



^S fe _ 1 (j) = 0(S n _ 1 (j)) 

k=l 

both hold, we deduce that almost surely on E, 



n \ ' — * / \ n 

\k=l 



and 



1 / n 

k=l 



\ai, — a J 



n 



< I ( £ max y/s^V)\\a* - |R ~ «*|| = O (^) . 



However, the estimator satisfies the equality 
— 1 n 



n k=i 



1 

n 



,fc=l 



n \ k=l / 

+ -(itsk-iti))(ai-ar(ai-aJy, 



n 
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(viii) hence 

1 n / 1 \ 

t n -K = -Y, Sl-i (A k - A) * (A k - A)S 1 k /2 1 - K + O ( — ) a.s. on E. 

n k=i \ n J 

This property shows the strong consistency of IC n on E. Moreover, com- 
bined with property (v) of Theorem 3.1, it allows us to affirm that asser- 
tion (vii) of Theorem 3.2 is also true for IC n . □ 

The proof of Theorem 3.1 becomes simple thanks to the next results, 
which establish that properties (iii), (iv) and (v) are in fact the transcriptions 
of analogous ones satisfied by the normalized martingale (p~ n ^ 2 A4 n ) or the 
sequence (£ n ) related to (M n ) by 



(3.1) Cn = Vect(C, . . . , CD, CI = V«0')(^') 1/2 AMt 
Note that 

(3.2) E(C„/0„-i) = O and E(CnCn/G n -i) = ^-i^n-i- 
3.3. Auxiliary results for the proof of Theorem 3.1. 

Lemma 3.4. For the sequences (M n ) and (Cn), defined, respectively, by 
(2.8) and (3.1), the following properties hold almost surely on E. 

(P 6 ) ASCLT: 

1 " / / W \ x / 2 

i n 

-V<5 -i/2 =$> S(/C), 

n f— ' -*fe-i Cfc n->oo 
fe=l 

where £(<f) is a Gaussian r.v. as in property (P5). 
(P 7 ) <5<5X: 

1 n 

-]Tp- fc (Mfc*M fc -<M> fc ) — 0, 

n L — * 71 — >oo 

fc=l 

n n->oo p — 1 



so - E *fc-YVc*<Ci /2 — £■ 



77 * — * n — ^00 

fc=l 

ft 



-1/2/.*/ V-V2 

72 ' — ' n— »oo 
fc=l 
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Moreover, if the reproduction distributions have finite moments of order 4, 
then: 

(P 8 ) LIL of the QSL: 

1/ n \ 1 n 

lim sup - 



limsup - 



/ n 



Vln In 



n 



\ 1 

s n k=l 

n 



(p - l) 3 / 2 



1 ^ 

n 



k=l 



2d. 



The proof of this lemma, except property (Ps), is postponed to Ap- 
pendix A. Property (Pg) is proved at the end of Appendix B. 

Lemma 3.5. Within the framework of the Theorem 2.1: 
(ix) The properties 

n 

J2S l k / _ 2 1 (A k -Ar(A k -A)sl /2 



k-l 



k=l 



nJC+(?-± )k}' 2 [ J2 P ~ k (M k *M k - (M) k ) )K^ + o{n^), 



W 



,fc=i 



it 

^2x 1 k /_\(A-AnA-A)xiz 



k=i 



= nJC + Y: X^(\Ck*Ck - x&Kxgjx^! 2 
k=l 

hold almost surely on E. 
(x) Consequently, 

n 

Y^W^sl^iAk-AW-nof 



k=l 



p-1 

w 



p- k tr(M k *M k - (M) k ) + o(n 1/2 ), 



k=l 



j2\\ic-y 2 x 1 k L\(Ai-A)f-nd 2 

n 

£ tr (XT l ' 2 X~^ ( Ck * W^K- 1 " -T S ). 



k=l 



k=l 
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This lemma is proved in Appendix A. 

Proof of Theorem 3.1. We only prove the results announced for the 
martingale (M n ) because the results that correspond to the sequence (£n) 
can be obtained in the same way. 

The property p~ n (A4) n — > n -*oo Itf a.s. on E, combined with the 
ASCLT satisfied by M. [see (Pe)], implies that, conditional on the set of 
nonextinction E, 

1 n 

-Y. 5 (p- k/2 M k , P -HM) k ) ^ V® S c a.s., 
k=i 

where \x is the law of the r.v. £((^y) 1//2 Z d 2) and C = (-^j)I d 2 is the almost- 
sure limit of {p~ k {M)k) on E. Hence we deduce property (iii) of the theorem 
for (M n ) thanks to (2.7), (2.8) and (2.9). 

Property (iv) for (M. n ) is a consequence of the QSL satisfied by the mar- 
tingale M [see (P7)] and the relation (ix) of Lemma 3.5. 

Likewise, the LIL stated in the theorem, for the sequence (S n -i(A n — A)), 
is a consequence of the LIL satisfied by (A4 n ) [see (Ps)] and the relation (x) 
of Lemma 3.5. □ 

4. Asymptotic confidence region for the parameters {a J , K^}j. Our 

goal here is to construct an asymptotic confidence region for all the param- 
eters {a? ,K^}i<j<d- The key tool is the CLT stated below for the pair of 
estimators (A n ,JC n ) and (A n ,^ n ). 

4.1. Central limit theorem for the pair of estimators (A n ,IC n ) and (A n , ^n) ■ 
The proof of the next theorem, based on some probabilistic results performed 
by the sequences {M. n ) and (Cn), is postponed to the end of Section 4. 

Theorem 4.1. Let X = (fl, ,F,P,F, (X n ) n >o) be a d-multitype branch- 
ing process, starting from 1 = *(1, . . . , 1). We assume that its reproduction 
distributions satisfy Assumption A-l with 5 = 2 and also Assumption A-2. 
Then, conditional on the set E or E n : 

(xi) We have 

{V^£n-/C),«S^1(A 

where is a r.v. distributed as A/^2 (0, KL) and, for T = Diag(T 1 , T d ), 
((5 r (T)) rg j lj2 } are independent identically distributed Gaussian matrices, 



n-A)} 



<9i 



p-1 



K +© 2 (/C),<5 , 



n -A)} ^ {6 2 (/C),6}, 
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which are also independent of&. Moreover the covariance matrix o/Vect(0 r (T)) 
is equal to 

Diag(T J ' ® T j + 1 - (Vect{T j )* Vect(T j )); 1 < j < d). 

(xii) PVe also have 

{^{triK-^KnK- 112 ) - d^S^X - A)} 
-L> m( 0,2d 2 ^^ ® AA d2 (0,/C), 

rwoo y p—lj 

AA(0,2d 2 )^AA d2 (0,/C). 

n— >oo 

4.2. Construction of confidence regions. Prom property (xii), and the 
fact that 

(4.1) — £— ^ a.s. on E, 

we deduce the following result, which allows us to construct an asymptotic 
confidence region for all the parameters {a- 7 , ^}i<j<d- 

Theorem 4.2. Conditional on the set E or E n : 

(xiii) We have 



2d 2 ((X 



n(X "' 1 i - ( Y ttUKiy^KUKt)- 1 / 2 ) - d 2 

n ,l) + 2(S n _ 1 ,l))^ 1 u ; n\ ) ) 



Y^Sk-im\(K j n r 1/2 (a 

3=1 



M(0,l)® X (d 2 ), 



j2Sk-im\(Kir l/2 (a 

j=l ) 

AA(0,l)® x (d 2 ), 

n— >oo 

where x(d 2 ) denote the chi-square distribution with d 2 degrees of freedom. 
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Remark 4.3. Let {a J , Kl}i<j<d ^ e a gi ven possible structure of the re- 
production means and covariance matrices. From Theorem 4.2 one can easily 
derive an asymptotic test of the hypothesis {aP ,K 3 }i<j<d = {a 3 Q, Ko}i<j<d 
against the alternative {a 3 ,iP}i<j<d / {a 3 , i^o}i<j<d- 



4.3. Auxiliary results for the proof of Theorem 4.1. 



4.3.1. The CLT of the QSL satisfied by (M n ) or (Q- For the QSL 
satisfied by the martingale (Ai n ) or the sequence (( n ), that is, property (P7), 
the rate of the weak convergence is given by the following technical lemma, 
which will be established in Appendix B. 



Lemma 4.4. If the assumptions of Theorem 4.1 are satisfied, then con- 
ditional on the set E or E n : 

(P 9 ) We have 



1 n 

-= Y, P~\M k *M k - (M) k ),p^ 2 M n 
v n fc= i 



c 

n— >oo 



Si 



2W 2 X 1 / 4 



(p-l)3 



i rf + s 2 



T 7 ! 



Irf ,S 



w x 1 / 2 



p-1 



v n k= i 

W X 1 ^ 



n— >oo 



S 2 (Id),S 



p-1 



where W, £(•) are r.w. 's as in property (P5) and (£ r (T)) rg { lj2 } are indepen- 
dent identically distributed Gaussian matrices, which are also independent 
of the pair (W, £(•)). The covariance matrix of Vect(S r (T)) is equal to 

(T®T)®(T®T)+ ± (Vect T*Vect T) M 1 (Vect T*Vect T). 

(Pg) In particular, 



fc=i 



,p- n/2 M, 



c ; 

n— >oo 



si 



(p -l) 3 /2 " 



^ +s J 2 



l<j<a! 

w 



p-1 



l<j<d 



W \V2 
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1/2 



1 

y n k=i 



l<j<d 

P~ n/2 M n 



n— >oo 



K(i d )] 1 <,< d ,s((— T J J d2 



where {E£(T),1 < j < d,r £ {1,2}} are independent identically distributed 
Gaussian matrices, which are also independent of the pair (W, £(•)). TTie 
covariance matrix of Vect(££(T)) is egwaZ to T (g> T + -'-(Vect T*Vect T). 
(Pio) Moreover, 



l=^p-Hr{M k *M k - (M) fe ),p- n/2 Mn| 



L £ tr(/c-v^-_Y 2 ( Cfe *a - ^ 1 Jc*i5 L )A^ 1 / 2 xr 1 / 2 ) >P -»/ 2 A< n 
n fc=l 



n— >oo 



where G is a standard Gaussian r.v., which is independent of the pair {W, £(•)}• 

4.3.2. T/ie CLT of the QSL satisfied by (A n ) and (A^ n ). Combined with 
Lemma 3.5, the previous result allows us to establish the following one. 

Lemma 4.5. If the assumptions of Theorem 4.1 are satisfied, then con- 
ditional on E or E n ; 

(xiv) We have 

jyW-l)^ jr KT^st^iAk - A)*{A k - A)SI / \1C~ 1 ' 2 - T d ?j , 
{S 1 (2 1 / 4 I,) + S 2 (( /0 -l) 1 / 4 I d ),©} ) 



n—*oo 
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where & is a r.v. distributed as (0, fC) and (E r (T)) T , g { 1 2 } are independent 
identically distributed Gaussian matrices, which are also independent of (5. 
The covariance matrix of Vect(£ r (T)) is equal to 

(T®T)®(T®T) + ± (Vect T*Vect T) M ± (Vect T*Vect T). 

(xv) We also have 



i> {I ± \\JC^slL\(A k -A)f- d^S^An - A)} 



In(p-l) (1 £ 
(P + 



N{0,2d 2 )®N d 2(0,JC), 



£ \\K- 1/2 XIL\{A -A)f- d^S l J\(A n - A)} 



Proof of Theorem 4.1. To prove property (xi) of the theorem for the 
sequence (fC n ), first of all we observe, thanks to property (ix) of Lemma 3.5, 
that for 1 < j < d, 



1 



n i/ 2 {Kl) -i/2 ^ S k ^(j)(a{ - aiy(a{ - a*) (^) 



'1/2 



k=l 



n 



1/2 X 



n 



(4.2) 



fc=l 



77 



1/2 A 



1 ^ 



n 



E( S ^iOr^(j))(Mi*Mi - (M^> fc ) 



fc=l 

w x - 1 



p-1 



i. 1 /2 < 



7) 



fc=l 



where A n (j) — > a.s. on E. Hence, according to property (P' g ) of Lemma 4.4, 
we can affirm that conditional on E or E r 



71 1 



II 



k=l 
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(4.3) 



n— >oo 



1 +TP 2 {K 3 ) 



where (25 is a r.v. distributed as A/^2(0,/C), independently of the r.v.'s T, J r (T), 
l<j<d,re{l, 2}, defined as in (P' 9 ). 

Now, we notice that we can replace ^ Y^k=i — aJ )*(^ — a- 7 ') by 

if^ in (4.3), because we have 



(4.4) 



k=l 



O ( —= In n 

In 



a.s. on E, 



thanks to property (viii) stated in the proof of Theorem 3.2. Hence, condi- 
tional on E or E n , we get the property 

1/2 



c 

n— >oo 



which implies that 



{Jn(p - l)(K n - K),S l JX{A n - A)} {(5i(V2/C) + 2 (y^T/C), 0} 



p-1 



1/4 



Kt)+T? 2 (Ki) 



,0 



n— >oo ' 



where, for T = Diag(T 1 , . . . , T d ), ®i(T) and (^(T) are independent iden- 
tically distributed Gaussian matrices, which are independent of (5. The co- 
variance matrix of Vect © r (T) is 

DiagtT 1 <g> T 1 + - L (Vect T^Vect T 1 ), . . . , T d <g) T d + - L (Vect T d *Vect T ')). 

Property (xi) is proved. 

Property (xii) of the theorem, for the sequence (JC n ), is a consequence of 
property (xv) of Lemma 4.5 combined with (4.4), which implies that 

yftLQc-WRjc- 1 /*) - - £ ||r%E(4-i)f)=of!^ 

V n k=i J \Vn 

a.s. on E. 

The proofs of properties (xi) and (xii) for the sequence (& n ) are similar 
to those of (/C n ). They are omitted for brevity. □ 
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5. About the least squares estimator of the mean matrix. The main 
contribution of this work is the global identification of the means and the 
covariance matrices of the reproduction distribution involved in a BGW(d) 
process. It was carried out thanks to the CLT of the QSL verified by the 
normalized estimation errors (S n -\{A n — A)) or [X n -\(A\, — A)), where 
A n or A^n is, respectively, the maximum likelihood or the empirical estimator 
of the reproduction law means. One may ask if it is possible to adapt this 
method by considering the least squares estimator (LSE) (see [29]) A n of 
the mean matrix A = [a 1 , . . . , a d ] instead of A n or A^ n . This question is quite 
relevant if the observed sample is the set of the first (n + 1) observations 
Xo, . . . , X n . 

At the beginning, let us discuss the simple case of the BGW process. The 
LSE of the mean law reproduction a [obtained by minimizing the function 
a i — >Efc=i( x fc -aX fc _x) 2 ] is given by 

/ n \ n 

(5.1) a n = (Q n _i) _1 x fc-iX fc , Q rt = ^X 2 , 

\fc=l / k=0 

and satisfies the relation 

n 

Q n „i(a n - a) = X fc _!(X fc - aX fc _i) 

= X fc _i(X fc - E(X fc /JVi)) = W„. 

k=l 

Noting that the predictable quadratic variation of the martingale (W n ) is 

n 

(W) n = a 2 T„_! with T n = Y Xg, 

k=0 

we can affirm, thanks to the martingale law of large numbers, that (a n ) is 
a strongly consistent estimator of a on the set E. Moreover, conditional on 
the set {X n > 0} (resp. E), the following CLT with random normalization 
holds too: 



n— >oo 

(5.3) 

n— >oo 

where 7 2 = ((a + l) 2 /(a 2 + a + 1))cj 2 > a 2 . 

The QSL associated with this CLT allows us to prove that 

n 

(5.4) a 2 l = n~ l y2 T k-iQl-i(ak-a n ) 2 — > a 2 a.s. on E. 

k=l 
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Using a CLT stated in [8], we have an analogous result to (1.5), which is 

Obviously, the estimators (a n ,a 2 ) are better than (a n ,a 2 ). However, as 
stated before, for the BGW(rf) process, the maximum likelihood or the em- 
pirical estimator of the reproduction mean matrix A is not a function of 
the first (n + 1) observations of the process, but is a function of a much 
richer sample drawn from the underlying tree generated by this process. So 
it is interesting to study the properties of the LSE (A n ) of A because it is 
a statistic of the basic sample (Xo, . . . ,X n ). More precisely, A n (calculated 
by minimizing the function A i — ► J2k=i W-^-k ~ AX-k-i\\ 2 ) is a solution of the 
linear system 

(n \ n 

x fc _!*x fc _! j = 2J x fc *Xfc_i. 
k=l ) k=l 

It is more convenient to define A n by the algorithm 

n 

(5.6) A n+ i = A n + (X n+ i - ^ n X n )*X n Q^ 1 , where Q„ = l d + ^ X fc *X fc . 

k=l 

Hence, A n satisfies the relation analogous to (5.2), 

d n 

(5.7) {A n - A)Q n . 1 = W^ n) where W n = ^ X^Cl 

3=1 k=l 

The global approach discussed before for the one-type BGW can be gener- 
alized successfully to the ci-type case. For this purpose, we need to add to 
Assumptions A-l and A-2: 

Assumption A-3. Every nonprincipal eigenvalue A of A satisfies |A| 2 > 
p. Moreover, A is nonderogatory. 

The last word means that the minimal and characteristic polynomials 
of A are proportional. 

Under Assumption A-2 and the first part of Assumption A-3, it was proved 
by Carvalho [5] that there exists a r.v. r/ that satisfies the property 

(5.8) A _Tl X ri — > T] a.s. (and also in mean square). 

n — >oo 

Moreover, when we add the second part of Assumption A-3, we get the 
important property (stated also in [5]): 

, , On the set of nonextinction E, the dx d matrix whose 

column vectors are [A _1 r/, . . . , A~ d r]] is invertible. 
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As a direct consequence of (5.9), the excitation Q n of X satisfies the result 
A- n Q n _i*A~ n — ► C a.s. on E, 

n— >oo 

where C = Yln^=i A.~ n rj*rj*A~ n is a.s. invertible on E. 
By adapting to the martingale 

^ n = *(Vect(Wi ),..., Vect(W^)) 

the tools used before for (A4 n ), similar results to those proved for the MLE 
A n (or the EE A^ n ) are available for A n = Vect(A n ). Details are intentionally 
omitted for brevity. 

Conclusion. A natural question remains: What is the best estimator of 
the variance? The answer to this question is part of a thesis in preparation. 

APPENDIX A: PROOFS OF LEMMAS 3.4 AND 3.5 

Proof of Lemma 3.4. The ASCLT satisfied by (M n ) or (£ n ) has been 
proved in [10]. Property (P7) for the martingale (M n ) is a special case of 
Theorem 3.1 in [8]. Property (Ps) for the martingale (M n ) is proved at 
the end of Appendix B. The proofs of the properties (P7) and (Ps) for the 
sequence (£ n ) are similar to those for (M n ). They are omitted for brevity. 
□ 

Proof of Lemma 3.5. To prove property (ix) of the lemma, we note 
that 

n 

n-V^K-V^V^ _ Af{ A k - A)SlL\lC-^ -Z*) 

k=l 

n 

(A.l) =n- 1 / 2 Y,(p k USl\) 1/2 P~HM k *M k -(M) k )(p k US^ 1 ) 1 / 2 

k=l 

(WT \ ' — 1 ^ 
— T J n ~ 1 / 2 Y / ^ k (M k *M k -(M) k ) + T n , 

where 

rn = n- 1 ^E(c^^ 1 ) 1/a -(^ I )" 1/a ^) 

1 /2 

x p~\M k *M k - (M) k ) (ip^S^) 1 / 2 - [—^j 1^ 
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+ 



W \-V2 



+ 



p-1 

w - 

p-1 



11 



-1/2 ' 



k=l 



£ (pWi) 1/2 



p-1 



Id? 



-1/2 ' 



~£p- fe (W.M fc -(.M} fe ) 



A.'=l 



x (pWi) V2 



p-1 



1<P 



Let us show that almost surely on E, 

(A.2) r n - 



0. 



Properties (P2) and (P3) imply p n \\M n *M n ~ (M) n \\ = O(lnn) = o(n) a.s. 
on E, so 



k=l 



W \-V2 



p-1 



Id? 



(A.S) +0[n- 1 ^k (pWi) V2 



k=l 



p-1 



X 



a.s. on E. 



To end the proof of (A.2), we need the following result, which is a direct 
consequence of property (Pi): For some real 9 g]0, 1[, 



(A.4) 



1 



k-l 



-wu 



0(Vlnkk d - 1 e k ) a.s. on E. 



p-1 

This implies that almost surely on E 

W \~V 2 



(pWi) V2 
Therefore, the series 



p-1 



^d? 



o{^\iikk d - 1 e k ). 



and 



fc=i 



k=l 



w v 1 / 2 

Id? 



p-1 



w \-V2, 



p-1 



^d 2 
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are a.s. convergent on E. By the Kronecker lemma, almost surely on E, 

n 

E * (p Wi) 1/2 

\y — j-/ 

W 



fe=l 



7 J d 2 



+ 5> (pWi) V2 
fe=i 



-1/2 



o(y/n); 



hence (A. 2) is proved thanks to (A. 3). 

Since property (x) is an immediate consequence of (ix), Lemma 3.5 is 

1/2 ^ 

proved for (5 n _ 1 (^l n - A)). 

The proofs of properties (ix) and (x) for (A^^G^, — A)) are similar to 

1/2 ^ 

those for (S n _ 1 (A n — A)). They are omitted for brevity. □ 

APPENDIX B: PROOFS OF LEMMA 4.4 AND PROPERTY (P 8 ) 



Proof of Lemma 4.4. The long and technical proof below is carried in 
several steps. These steps are intentionally detailed in a way so that results 
on the sequence (£ n ) appear to be contained in those on the martingale 
(A4 n ); hence the proof will be focused on (M n ). 

Step 1 — Preliminary calculus. Let 

n 

Z n = Y J P~\M k *M k - (M) k ), 



(B.l) 



k=l 



/2 



fc=l 



be the random block matrices whose blocks of indexes i and r, 1 <i,r < d, 
are 



Z n (i,r) = 5>-*(Ml*M£ - (M\M r ) k ) 



k=l 
n 



4(^r) = E(X fc -i«" 1/2 X fe -i(r)- 1 / 2 (^)- 1 / 2 CrC fe r (^ r )- 1/2 -I (i ) 

k=l 

To prove property (Pg), we need the decomposition 

P i) H^k-^r) - (M i ,M r ) fe ) 



2 n {i,r) 



p 
p- 



7 ) E P _fc ( M i-l*( AM fc) + ( AM fe)* M fe-l; 
' fe=l 



+ 
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P 



P 



- ) X>-*((AMi)*(AM£) -E((AM|)*(AM£)|e fe -i)) 
y fc=i 



ip" (n+1) (M^*M; - (M l ,M 



From (P2) and (P3), we have 

n -l/2(_PA ( n +l)( M * M _ {M)n) _^ a g Qn E 

hence, 

(B.2) (^^Z n (i,r) = #;' r + #^ + o(^) a.s. on E, 
where for 1 <i,r < d, 

n 

Hi? = £ p- k (MU*(AMl) + (AM|)*M^_ 1 ), 

k=l 

n 

H^ = J2p' k ({AMl)*(AMl)-E((AMir(AMl)\g k ^)) 

k=l 
W / 

= — S- n (i,r) + O(lnn) a.s. on E. 
P 

For the study of the weak convergence of the sequence (2 n ), we consider the 
martingale block matrices 

H n = (Hn r )i<i, r <d, H n = (H^ r )i< ir <d, 
W n =Vect(H n )=Vect(Hi,...,Hf), 

W n = Vect(H ft )=Vect(Hi,...,Hf) and M n = . 

The continuation of the proof is, in particular, based on application of the 
classical CLT (see [15]) to the martingale (H n ). 

Step 2 — Behavior of the predictable quadratic variation of (H n ). Here- 
after, we study the asymptotic behavior of the predictable quadratic varia- 
tion 

{H $;)° i 

where 

(H)n = ((H p , H 9 ) n ) M < d 2, 
(H)n = ((H p , H 9 )n)p,q<d?, 
{H, H) n = ((H P , V\ q ) n ) p q < d 2 . 
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To determine the asymptotic behavior of ((M) n ), the formulas below are 
needed, where (ei, .. . , ej) denotes the canonical basis of M. d . For 1 < r < d, 
1 < s < d, we note that 

u(r-l)d+s _ *(* Tjl,r * zrd,r \ 

u(r-l)d+s _ */* frl,r * frd,r \ 

Then, for p= (r — + s and q = (I — l)d + t with 1 < r, Z < d and 1 < s, t < d 
fixed, 

(H p , H' 3 ) n = ({H^ r e s , H^ l e t ) n )i<i,j<d, 

(H p , H c/ )n = {(H l n T e s , Hl' l e t } n )i<i,j<d- 
(A) Behavior of (7i) n . For 1 <i,j <d,l <r,l <d, 1 < s,t < d, we have 



^p- 2fc ML 1 *Mt 1 E((AMLe s )(AMi,e t )|^„ 1 ) 
fc=i 

+ ^p- 2fc Mt 1 (Mt 1 , et )E((AM5-,e s )*AMi.|g fc _ 1 ) 
fe=i 

+ X:p" 2 "lE(AMl(AMi,e t )|g fc _ 1 )(Ml._ 1 ,e s )*Mi_ 1 
fc=i 

+ f: p - 2fc (ML 1 ,e s )(Mt 1 ,e t )E((AMy*(AMi)|g fe _ 1 ), 



k=l 
id. 



(H^e s ,H^e t ) 



1 n 
1 n 

+ 7 _^p- 2fc Mt 1 *Mi_ 1 e t *e s (ifT 1 /2 
V u ( r )«U) 



x E(crai^i)(^r 1 / 2 

1 ™ 

+ / n ^ E/ 3 " 2fc (^)~ 1/2E (a*Ci|g fe - 1 )(^')- 1/2 et*e s MLi*Mi, 1 

v«(*)«(0 ^ 
1 n 

+ £ p- 2fc *e s M£_i*Mi_ 1 e,(^)- 1 / 2 

v«(*)«u) fe =i 

xE(crdia fe -i)(^r 1/2 . 
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Consequently, 

/ n N 
(H^e s ,W' l e t ) n = (e r , ei re s e t ]T U (r)- 1 X fe _ 1 (r)p- 2fc Ml_ 1 *M J fe _ 1 



,fc=i 



+ < ej , e r ) £ u(r)- 1 X fc _i(r)p- 2fc ]N4_ 1 *Mi_ 1 e t *e s 
(B.3) U f 7 



.k=l 
' n 



+ {e i ,e j )\^u{^- 1 yi k _ 1 {e jp - 2k *e s Ml_ l *m\_ 1 e t l d y 



From (B.3) and the properties 

^(^^(r) — W«(r) 



(B.4) 



1 £ p-^^MLx^Mi^ ^ (-^1,) <e r , e,) a.s. on E 



we can affirm that, almost surely on E, 
1 • 2W 2 

-{H l ' r e s ,H h e t ) n — ► — (*e i Ide j (e r ,ei)(e s ,et)Id + *ei(ei*e r )e j (et*e s )). 

n p z (p — 1) 

So, we deduce that 

1 2W 2 

-(H P ,H% — ► -((e r ,e,)(e s ,e t )I d <g>I d +(ej*er)® (e t *e fl )) 



a.s. on E 



and 



1 2W 2 

- (W n — ► -57 rr{ (Id Old)® (I d ®Id) + J®J} a.s. on E, 

where 

(B.5) J = ± (Vect(I d )*Vect(I d )) = (e,*er)i<r,Kd- 

(B) Behavior of ((7i) n ). For 1 < z, j < 1 < r, I < d, 1 <s,t < d, we have 

= f j p^ k E((AMir(AM{)(AMl,e s )(AMle t )\g^ 1 ) 
k=l 
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- £ p~ 2k E((AMl) (AMI, e,) \G k -iM* (AM{)(AMi, e t ) \G k ^), 

k=l 

(ir> r e s ,W> l e t ) n 

1 



y/u(i)u(r)u(j)u(l) 

n 

Y^p- 2k mKr 1/2 cr(i(K>)- 1/2 

e s (in- 1/2 crci(^r 1/2 *-i; 



X 
k=l 



(B.6) 



x 
1 



yju(i)u(r)u{j)u{l) 

n 



x 

k=l 

xE(Crai^_i)(^r 1/2 e/ei(^)-V2 E(C ^^|^_ 1 )(^)- 1/2 - 

Consequently, if we set Cii = (-^ i ) _1//2 (Ci i — aJ )> then on the set (Xfe_i(z) x 
X fc _ 1 (j)X fc „ 1 (r)X fc _ 1 (0/0}, 

E((^)" i / 2 cra(^')- 1/2 *e s (^ r )~ 1/2 crci(^)- 1/2 eti^i) 

//x»_!(i) x /x fc _!(i) v /x*-i(0 \ /x fc _!(0 v 

=®(( E 3UJ*( E §UJ*e.( e E §UJ 

X fc _i(i) Xfc.iO') X fc _!(r) X fc _!(0 

\ ' \" \" \" qCW,/) 

- ^(n^unM)' 

u=i ji=i n.=i ii=i 

where 

To calculate 0^' r ' . , N the following three cases must be examined: 

Case 1. The four indexes i, r, j, / are equal. 

Case 2. Exactly three indexes from {i,r,j,l} are equal. 

Case 3. Two indexes at most from {i,r,j, 1} are equal. 

In Case 2, 0^ r,j '°. , , = 0, since for s E E M d , 
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Likewise, 

(iiji,ri,Ji) y (nji,ri,h) y (uji,n,ii) y 

In Case 3, 0& r J^ ^ ^ = 0, except perhaps in the following subcases: 

(a) If (i,r,j,l) G Ai = {(r,r,l,l); 1 <r,l <d,r j^l}, then 
(K!Li) = E (^u^i,r 1 )e s * et E(H Ji ^ li/i ) = (eSet^iunJM. 

(b) If (i,r,j,l) G A2 = {(z,r, i,r); 1 < i,r < d,i ^r}, then 

(c) If (t, r,j, l)eA 3 = {(l,r,r,l);l<l,r<d,l^r}, then 

In Case 1, (z, j, r, Z) G A4 = {(r, r, r, r); 1 < r < d}. Then 

(Kni,M = E ( (e. , g, n ) < , * ) ) 

= E(^/^ 1 (e s ,^,i)(^i,et))lA 4 (n,r 1 ,i 1 ,/ 1 ) 

+ (e s *e t )l Al (ii,ri,ji,Zi) + (e s , e t )I d l A2 (i l5 n, ji, Zi) 

+ (ete s )lA 3 (n,n,ji,M- 
The discussion above allows us to affirm the following statements: 

if i = r = j = I, 
(H*' r e s ,H^e t ) n 
1 



(B.7a) 



(B.7b) 



2 p- 2fc X fc _ 1 (r)E(^ 1 *^ 1 *e s ^ 1 *C 1 , 1 e*) 

1 n 

+ ^y> X] / o~ 2fc X fe „i(r)(Xfc_i(r) - l){*e s e t I d + e t *e s + e/e t } 
1 n 

-^2E^ 2fc ^i(r) 2 {e/ ei }; 

]£i = j^r = l, 

~ 1 n 

(H^e s ,W' l e t ) n = ... . J2p~ 2k ^k-i(i)^k-i(rTe s e t l d ; 
u(i)u(r) ^ 
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(B.7c) 

~ ~ 1 
(H^ r e s ,H^ l e t ) n = -—- ]T p- 2k X k ^{l)X k _ x {r)e t * e s - 
u(l)u(r) ^ 

(B.7d) if (j,l)t{(i,r),(r,i)}, (H i > r e s ,W> l e t ) n = Q. 
From properties (B.4) and (B.7a-d) it follows that, a.s. on E, 
1 ~ ■ ~ • , W 2 

-{H l ' r e s ,W> l e t } n — ► ^(*e s e f I d + e f *e s ) if i = r = j = l, 
-{H^e s ,H^ l e t ) n — ^-*e s e t I d ]£i = jjL r = l, 

n n->co pi 

-{H^e s ,H^ l e t ) n — ► ^e t *e s ifi = Z^ r = j, 



and 



-(H^es^^etU — * if £ {(z,r),(r,i)}. 



11 n— >oo 

Consequently. 
1 



-(H^e s ,H^e t ) n 
n 



hi 

w 2 

n— >oo p2 



(e r , e;)(ej, e r )(ei, ej)(*e s etl d + e t *e s 



W 2 

H T-((er,ez)(ei,ej)(l - (ej,e r ))( e s e t I d ) 

+ (ei,e/)(e T .,e i )(l - (e*, e r ))et*e s ) 

W 2 



(*eiI d e J -(e r ,ez)(e s ,e i )I rf + *ei(e;*e r )ej(e t *e s )) a.s. on E, 



so 



1 ~ ~ W 2 

-(H P ,H<% — ► ^((e r ,e l ){e a ,et)I d ®I d + (e*e r )®(et*e a )) a.s. on E. 

fl n — >oo p z 

Finally, 

1 ~ W 2 

-(H) n — ► -5- ((Id® Id)® + JO a - s - on E ^ 

72 n^oo p 

where J is defined by (B.5). 

(C) Behavior of {{H,H) n ). For 1 < i, j < d, 1 < r, I < d and 1 < s, t < d, 

hi. 



(H*' r e s ,H^e t ) 
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n 

^p- 2fe M^ 1 Er(AM^(AMi, es )(AML, et )|g fc _ 1 ) 

k=l 

n 

+ Y / p- 2k (M{_ v e s )E(AMi*(AMl)(AM l k ,e t )\g k - 1 ) 

k=l 

1 



^Ju{r)u{j)u{l) 

n 

fc=i 

i 



+ 



V 'u(r)u(i)u(l) 

n 

x y: p" 2fc (Mi_ 15 e s )E((^)- i / 2 cra(^ r )- 1/2 *ci(^)- 1/2 e i ia fc -i); 

fc=l 

hence, 

(H l > r e s ,W' l e t ) n 

1 n _ _ 

^p- 2fe X fe „ 1 (r)M^ 1 E(*^ 1 *e s e[, 1 *^ie i )l b=z=r} 



U(V) 3 / 2 ^ 



X 
U( 



Consequently, 

-(H i ' T e s ,H^ l e t ) n — >0 a.s. on E and -(H,H) n — >0 a.s. on E. 

77, n— >oo 77, n— >oo 

Step 3 — Verification of the Lindeberg condition for the martingale HI. 
For all e > 0, we have 

i^E(][AH fe || 2 l {1|Mfc||>eVH} |^_ 1 )^0 a.s. onE. 

k=l 

In fact, thanks to the properties 

max || AHfc|| = O(lnn) and max || A7Yfc || = O(lnn), 

l<fc<n l<fc<n 

which hold a.s. on E, we have 

1 {||W fc+1 ||+||'H fc+1 ||> £ v / S}n^ a ' S ' ° nE ' 
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Consequently, 
1 ^ 



n 



^E(||AM fe || 2 l 



{||H fc ||> £v ^} 



n}\Gk- 



k=l 



1 n 

<-^E(||AW fc fl 

n 



k=l 
n 



{||W fc || + IIH fc |l>£v^} 



+ -EE(||AH,|| 2 Vfcl|+|| ~ fcj|>£v/H} |^ 1 ) 



k=l 



°(^x:p" fe [i^ii 2 ) + ^f: E (p" 2fe [i^^ii 4 i^-i)) 



= o(l) a.s. on E, 
because the r.v.'s 
'l 



k=l 



k=l 



are almost-surely bounded on E. The Lindeberg condition for (H n ) is proved. 

Step 4 — Weak limit of (^H n ). From the classical martingale central 
limit theorem [17, 27], it follows that, conditional on E, 



(B.9) 



77, n — »oo 



V 



p 2 (^-i; 

E 2 (,/^I £ 



where (£ r (T)) rg { lj2 } are independent identically distributed Gaussian vec- 
tors, which are also independent of the r.v. W. The covariance matrix of 
E r (T) is equal to (T(g>T)<g>(T<g>Y) + ± ( Vect T * Vect T) K x ( Vect T * Vect T) . 
Conditional on E n , this result remains true. □ 

Proofs of (P 9 ) and (P' 9 ) . Hereafter, we use Theorem 3 of [27] to prove 
a CLT for the couple of martingales (M n ,M. n ). Properties (Pg) and (P 9 ) are 
consequences of this result. 

For the vectors x = (z^-i)^)^^^ z = 0(z_i)d +i )i<M<d and y of M rf2 , 
we set 

K = ut 1)d+s ) + EE(^i )Wl v\t 1)d+t ), 

i=i t=i 



r=l s=l 



u 



(n) 



]=AH! k + {y,p- n / 2 AM k ), 
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l n (x, Z, y) = 3n((s(r-l)d+s)l<r, a <d' ( z (/-l)d+t)l<Z,i<^ V) 
n 

= niE{exp{iAul n) }|g fc _ 1 }, 



fc=i 
n 



<f> n (y) = 1] E(ex V {i(y,p n / 2 AM k )}\g k ), 



k=l 



^ n (x,z) = 

k 



Qk- 



From the results proved in Steps 1, 2, 3 and 4, Case 3, the following classical 
property holds: 

(B.10) $> n (x,z) — >^ 00 {x,z) a.s. on E, 

n— >oo 

where 

{ 1 2W 2 



exp < 



2p\p-l) 



/ d d d d 

E E E E * ( ( e r , ei ) (e s , e t )Id ® Id 

\r=ls=lZ=l i=l 

+ (ei *e r ) <g> (et *e s ))x (i _ 1)p+t 



(B.H) 

f 1W 2 

x expj 



2 p 2 

(d d d d 
EEEE%-i>+s 
r=la=l i=l t=l 

x ((e r ,ej)(e s ,et)I d ®I d 

+ (ej *e r ) (8) (e t *e s ))z^_i )p+t 

We also recall property (P4), which states that 

(B.12) c J > n ( y )^$ 00 (y)=exp|-i^ I y||y|| 2 | a.s. on E. 

Now let us prove that, almost surely on E, 

(B.13) R n = \E n (x,z,y)-$ n (y)W n (x,z)\ — > 0. 
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For this purpose, the following inequalities, also used in [28], are relevant: 
R n <^f^W.(\(y,p- n / 2 AM k )\x\AW k \\g k _ 1 ) 
i n 

+ — Y,n(y,p' n/2 ^M k ) 2 \g k ^)E((AW k ) 2 \g k _ 1 ) 
4n k=i 

i n 

<^^E((y,p-"/ 2 AM (t ) 2 |g (t _ 1 ) 1 /2 E(( AIHl' fc ) 2 |g fc _ 1 ) 1 / 2 
v n k= i 

1 n 

(B.i4) + — Y.H(y,p- n/2 ^M k } 2 \g k ^)E((AM' k ) 2 \g k ^) 
4n fc=i 

\ 1/2/ n 

maX n E((AH' fc ) 2 |e fc -i)J p"" *yA(.M} fc2 , ) 

+ i- max E((AH' fc ) 2 |g fe _ 1 ) £ P~ n *yA<M) fc y. 



\ 1/2 



4n i<fc<n 
In fact, thanks to the inequality 



k=i 



Y[a k - Y[b k 

k=0 k=0 



k=0 



which holds for \a k \ < 1 and \b k \ < 1, we have 



E((l-exp{i(y,p-"/ 2 AM fc )})|^ 1 ) 
x E( [ 1 -exp 



gk- 



and the last quantity is less than the right-hand side of (B.14), thanks to 
the inequalities 



|e lx -l|<|x| and \e tx - 1 - ix\ < 



x 



combined with the fact that E(A^ fc |^_i) = E(AM / fc |J r fc _i) = 0. 

Because the sequence (n~ 1 {M') n ) is almost-surely convergent on E, then 



- max E((AWu) \gk-i) — ► a.s. on E. 

n Kk<n n~»oo 
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We also have 



-(n-k)/2 



0(1) 



a.s. on E. 



k=i 



,k=l 



Hence, property (B.13) is proved. Therefore, from (B.10) and (B.12), 

E n (x,z,y) — ► E 00 (x,z,y) = V 00 (x,z)$ 00 (y) a.s. on E. 

n — >oo 

Consequently, by Theorem 3 of [27], we can affirm that, conditional on E, 
1 



K,P 



(B.15) 



c 

n— >oo 



' n/2 Mr 



2W 2 



P 2 (p 



\ 




So W — I 



w V/ 2 



p-1 



2, 



J 



where £(•) is a r.v. as in property (P5), and (£r("))re{l,2) are r.v.'s indepen- 
dent of the pair (W, £(•)) and distributed as in (B.9). Since property (B.15) 
is also valid conditional on E„, property (Pg) for the martingale (M n ) fol- 
lows from (B.15). 

According to (B.2), (B.15) implies that, conditional on E or E n , 



1 n 

^2W 



c 

n— >oo 



x V(p- 1) 3 / 2 " 



,p 

l<i<d 

w 



- n/2 M r 



p-1 



Ki<d 



W \V2 



p-1 



2d? 



where {S*(T); 1 < i < d,r G {1,2}} are independent identically distributed 
Gaussian matrices, which we can choose independently of the pair (W, £(•)). 
Moreover, the covariance matrix of Vect(S* (T)) is equal to T(8)T+- L (Vect T x 
*VectT). Hence, (P 9 ) is proved for the martingale (M n ). □ 

PROOF of property (Pio)- Property (B.15) combined with 

n 

J2p' k tiiM k *M k -(M) k ) 
P 



k=l 



(B.16) 



p 



)/ d d d d \ 

\r=ls=l r=l s=l / 



a.s. on E, 
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allows us to affirm that, conditional on E or E n , 

{1 n If// W \ 1 / 2 



where G is a standard Gaussian r.v., which is also independent of the 
pair (W,£(0) and r 2 = ((2W 2 d 2 (p + l))/(p - l) 3 ). In fact, according to 
(B.10) and (B.16), if x and z are the vectors of the canonical basis of M rf2 , 
then 

d d 



p-1 

P 



P 2 (p-!) r =i s =i 
W 2 d d 

H 2~^^((e r ,e r ) 2 (e s ,e s ) 2 + (e r , e r ) 2 (e s , e s ) 2 ; 

r=ls=l 

4W 2 d 2 2W 2 d 2 _ 2W 2 d 2 (p + 1) 



p 2 (p-l) 



p 2 (p-i) 



The proof of Lemma 4.4 is complete. □ 



Proof of property (Pg). Let us prove the LIL announced in Lemma 
3.4 for (M n )- The martingale 

7 _ //Vect(J d2 )\ 

satisfies the LIL 

limsup(2(Z) n lnln(Z) n )" 1/2 |Z n | = 1 a.s. on E. 

n— >oo 

This fact is a consequence of the LIL stated in [6, 7]. In fact, the properties 
\\p~ n / 2 M n \\ 2 = 0(lnn), (C) n = 0(n) 

and 



E(|| /0 ^/ 2 AA^ n || 4 |g n _ 1 )=O((ln 



n 



a.s. on E, imply that J2 n >i E(|((£) n ) _1 / 2 A£ n | 4 |^ ri _i) < 00 a.s. on E. Since 

2W 2 ci 2 (p + l) 



p 2 (p-l) 



a.s. on E, 



we deduce the LIL 



lim sup 



n 

In In n 



1/2 



1 n 

-J2p~ k tr(M k *M k -(M) k ) 



k=l 



2d 



W(p + l)V 2 
(p-1) 3 / 2 

a.s. on E, 
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taking in account the relation (B.16). 

The LIL announced in the second part of (Ps) may be deduced easily 
from the last property, since we have 7i n = ^jf&n + 0(hxn) a.s. on E. □ 
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